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operating system and other system programs 2.31 
-web browser and associated applications 2.32 
-web server applications 2.33 
-program modules, agents etc. 2.34 
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-Communications and network applications 2,36 
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-files 
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with corresponding 
Key Elements 
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Key Element identifier List (Key List) 4.0 

^ ^ 4.2 
Key Element 1 Identifier 

harry potter and the goblet of fire | 0 

101 vacations to change your life 1 1 

harry potter & the doomspell tournament j 2 

harry potter & friends | 3 

harry potter & the chamber of secrets 1 4 

the brethren | 5 

1999 zagat america's top restaurants | 6 
chicken soup for the mother's souf | 7 
tuesdays with morrie ] 8 
easy prey [ 9 

harry potter & the goblet of fire 1 10 

oh, the places youll go [ 1 1 

harry potter & the prisoner of azkaban j 12 

harry potter & the sorcerer's stone j 13 

heartbreaker 1 14 

who moved my cheese? 1 15 

it's not about the bike 1 16 

the house on hope street j 17 

peanuts j 18 

before i say good-bye 1 19 
britney spears I 20 
body-for-Hfe j 21 

dr. Shapiro's picture perfect weight loss j 22 

dust to dust | 23 

the bear & the dragon | 24 

the lion's game 1 25 

sony playstation 2 1 28 

ten things i wish i'd known-before i went out into the real world | 27 
dragonball z \ 28 

secret codes for sega dreamcast \ 29 

purple cane road i 30 

titleist [ 31 

titleist irons | 32 

titleist drivers | 33 

palm iii | 34 

palm v j 35 

palm vi j 36 

apple computer | 37 

harry henderson | 38 
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Browser detects that the user has 
navigated to a new electronic page. 
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! Retrieve the collection of all frames in 
! document 



X 



If frame contains multiple sections » 
retrieve predefined sections from the 
current frame. 



6JS 

Maintain a list of Key Elements and 
their positions in the current section. 




x Another frame exists?- 



f 6J0 
! Alter the current section by inserting 
\ annotates in the section so they are 
j asociated with the Key Elements. 



No 



No 



&2S 

Finished annotating the document. 



\ 

Anolher section > 
exists? S 



Yes 



6.1,4 

Make the current section the next 
section. 



FIG. 6 



J 



7.0 



72 

User selects an annotated Key 
Element 



! JA 
\ The user's computer system sends a 
1 request to an application on the CCS, 
i specifying (he Key Element identifier 
I for the annotated Key Element. 



<^ identifier exists in >- 
\ database? / 



\ 7J4 

The identifier does not exist. Take 
prescribed course of action, e.g., 
inform the user that the annotated key 
element is no longer supported. 



Yes 

JL 



TA 

Identify the target page URL 
associated with the Key Element 
identifier. 



LIS 

Instruct browser to redirect itself to the 
target page URL 



7.12 

User's computer receives data from 
target URL 
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BROWSER 2.32 



Tracfeer Module 



20 

Recognizee Module 
— - — T— 



§0 

Annolalof Module 



CLIENT 
(CONSUMER) 
COMPUTER 
SYSTEM 



14 

Key List 



8 ' 2a ! \ 8 10 

Annotated document }~, \ * L 

*, L_A User selects 

\ annotated Key / 

\^ Element / 



8.12 
Target document 
returned to Client 
computer 

i 
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Network cloud 
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User starts browser, e.g., Internet 
Explorer, 



i 

T 



9,4 



internet Explorer loads the Key ! 
Element Browser Helper Object (BHO). 



9,6 

The BHD contacts the CCS server, 
asking what version of the Key List is 
available. 



as 

\ Newer list available? 

y 

y 

NO 



> 



9.12 

Load the Key List from the user's 
computer 



9.10 

-Yes Load a new version of the Key List 

from the server. 



9.14 

Generate a set of key element list 
maps In memory from the Key List. 



9.16 

Stay alive until Internet Explorer 
terminates. While the BHO is alive it 
includes a tracking for determining 
when the user goes to a new web 
page. When notified, the BHO 
annotates the new web page. 



9.18 

Browser closed. The BHO releases all 
resources and terminates. 
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11.2 \ 
PRODUCT SEARCH) 
MODULE J 



11.0 



1M 

QUERY BASED ON 
ANNOTATED KEY 
ELEMENT 
SELECTED BY 
USER 



- optional- 



US 

s> DOES USER HAVE PROFILE " 
STORED ON ASSOCIATED^, 
COMPUTER SYSTEMS 



-yesfc- 



11.1Q 
MODIFY QUERY 
ACCORDING TO 
USER PROFILE 



11.6 

INPUT QUERY 
INTO SEARCH 
ENGINE 



-optional 



11.12 
RUM QUERY IN 
PRODUCTS 
DATABASE 



11.14 
RUN QUERY ON 
NETWORK, e,g, j 
WORLDWIDE WEB J 



11.18 
RETURN OUTPUT 

OF SEARCH 
ENGINE TO USER 



target page may include user 
interfaces allowing User to 
electronically undertake 
transactions such as select and 
pay for presented products 
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Monthly Review of Tech Gadgets 

The Palm V™ 

A perfect mobile device featuring. , , _ 12.2 

Hot Laptops / 

The Sony Vaio™ leads the pack not on}y for extra options 

but has the whole multimedia rilneyards thrown in... 
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YOUR ACCOUNT [ HELP I WHAT DO YOU THINK OF OUR SITE? 




home > search results 



Search Marketpiacg^lM rh 6 matc hes for "nine yards" 
13.5 



'nine yards' 1 - 



in 



Entire Marketplace 



Top 2 Popular Product Matches 
The Whole Nine Yards ( dvd \ vhs) , 2000 



L-j 3 7 The Whole Nine Yards by Original Soundtrack, { eg) , 02/29/2000 



Browse 

Ail Departments 

Departments 
Apparel 

Books & Magazines 
5.°I!lP ute!r H ardw are 
Computer Software 
DVDs & Videos 
Electronics 
Food & Drink 
Gifts & Rowers 
Health & Beauty 
Home & Garden 
Music 

Office Supplies 
Pets & Hobbies 
Sports & Outdoors 
Toys & Video Games 
Services 
Auctions 
Automotive 
Personal Finance 
Travel & Leisure 



Mor$ Product Matches 

DVD & Videos 

Top Matches 

The Whole Nine Yard s (DVD | vhs) , 2000 



Q Music 

Top Matches 

The Whole Nine Yards by Original Soundtrack, ( cp) , 02/29/2000 
The Nine Yards [Edited] by Paperboy, { CD icass) 1 12/16/1933 
Th e Nine Yards [ PA] by Paperboy, { CD j Cass) , 1 2/1 6/1 993 



Pets & Hobbies 

Top Matches 
Collectibles 



Toys & Video Games 

Top Matches 

Outdoor Games & Fun > Other 
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